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Abstract 

In addition to the emergent complexity of patterns that appears 
when many agents come in interaction, it is also useful to characterize 
the dynamical processes that lead to their self-organization. A set of 
ergodic invariants is identified for this purpose, which is computed in 
several examples, namely a Bernoulli network with either global or 
nearest-neighbor coupling, a generalized Bak-Sneppen model and a 
continuous minority model. 

1 Introduction 

When a set of agents come in interaction there are, in general, thresholds on 
the interaction strength above which the whole system self-organizes into dis- 
tinct patterns of collective behavior. If the dynamics of the agents and their 
interactions are fixed for all time, the formation of collective patterns is of 
no concern for the agents themselves. Rather, the identification of patterns 
belongs to the information compression process of the external observers. 
However, if the agents themselves are capable of adaptation to the environ- 
ment, then, the nature of the collective phenomena strongly determines the 
process of coevolution. 

Patterns of collective organization imply a correlation between the con- 
figurations in phase space for the components of the system. Therefore quan- 
tities like the entropy excess or the statistical complexity M B B, may be 
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used to characterize the complexity of the patterns that arise as a result of 
the interactions. However, because the formation of the patterns is related 
to the nature of the dynamical laws, it seems appropriate to look also for 
quantities that relate directly to the dynamical process of self-organization. 
Physically, the most relevant indices must be those that are robust in a prob- 
ability sense, that is, that are invariant almost everywhere in the support of 
a physical measure. Therefore in this paper one looks for ergodic invariants 
and, in particular, for those that emphasize the dynamical relations between 
the system as a whole and its parts as well as those that provide a dynamical 
characterization of the collective structures. 

Conditional exponents, corresponding to several splittings of the system, 
when compared with the full Lyapunov exponents, are a measure of the dis- 
tinction between intrinsic dynamics and the dynamics that arises from the 
interaction itself. On the other hand the conditional entropies corresponding 
to cylindrical splittings of the phase space characterize the relative indepen- 
dence of the parts in a collective system. The information provided by the 
conditional entropies is, in general, not equivalent to the information pro- 
vided by the conditional exponents. 

Another kind of information that is relevant to the characterization of 
composite dynamical systems is the nature and origin of collective structures. 
Structures, either temporal or spatial structures, are features that occur at 
a (time- or space-) scale which is small as compared to the scale of the 
individual components when in isolation. Temporal structures are found to 
be related to the variation of the Lyapunov exponents with the interaction 
strength. Of particular relevance is the critical behavior that occurs in regions 
where some of the Lyapunov exponents approach zero. This is used to define 
a structure index for temporal structures. 

Conditional exponents, conditional exponent entropies and structure in- 
dices are computed in several examples and related to their dynamical fea- 
tures. They seem to relate well to the dynamical features in Bernoulli net- 
works, both with global and nearest-neighbor couplings, and in the general- 
ized Bak-Sneppen model studied in Sect. 5. 3. As for the last model that is 
studied, a continuous version of the minority model, it belongs to a class of 
models where the agents do not interact directly among themselves but only 
through a common environment. In turn, the environment is a collective 
variable that the agents themselves create. For this class of models, condi- 
tional exponents, in particular, are not relevant and some other invariants, 
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beyond those developed in this paper, may be needed. 



2 Conditional exponents and conditional ex- 
ponent entropies 

A dynamical system lives on the support of some measure fi which is left 
invariant by the dynamics. An ergodic invariant is a dynamical characteri- 
zation of this measure 

1 T 

1 (aO = lim — F (f n x ) a:o A* — a - e - 

n=l 

Self-organization in a system concerns the dynamical relation of the whole 
to its parts. The conditional Lyapunov exponents, introduced by Pecora 
and Carrol Q [f| in their study of synchronization of chaotic systems, are 
quantities that in some sense try to separate the intrinsic dynamics of each 
component from the influence of the other parts in the system. 

Let a mapping / : M — > M , with M C R m and an invariant measure 
/i define a m— dimensional dynamical system. The conditional exponents 
associated to the splitting £ = R k x R m - k are the eigenvalues ^ and ^f 1 ^ 
of the limits 

lim {D k r*(x)D k f n (x))^ 
lim {D m _ k r*{x)D k f n {x))^ 

n—*oo 

where D k f n and D m _kf n are the k x k and m — k x m — k diagonal blocks 
of the full Jacobian. The conditional exponents are good ergodic invariants. 

Lemma. Existence of the conditional exponents as well defined ergodic in- 
variants is guaranteed under the same conditions that establish the existence 
of the Lyapunov exponents 

Proof: 

Let \i be an ergodic /—invariant measure. Then, Oseledec's multiplicative 
ergodic theorem, generalized for non- invert ible / § @ implies that if the 
map T : M —>■ M m from M to the space of m x m matrices is measurable 
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and 



J M^)log + ||T(x)|| <oo (1) 

(with log + g = max (0, log*?)) and if 

T: = T(r~ 1 x).--T(fx)T(x) (2) 

then 

lim (T™T:)^=A X (3) 



exists \x almost everywhere. 

If T x is the full Jacobian Df(x) and if Df(x) satisfies the integrability 
condition, the Lyapunov exponents exist fx— a e. 

If the Jacobian satisfies (HD , then the mxm matrix formed by the diagonal 
k x k and m — k x m — k diagonal blocks also satisfies the same condition. 
Therefore conditional exponents too are defined /x-a. e.. 

Furthermore, under the same conditions, the set of regular points is Borel 
of full measure and 

lim -\og\\D k f n {x)u\\=^ ) 

n— >oo ti 

with O^ne E x /E x +1 , E x being the subspace of R k spanned by eigenstates 
corresponding to eigenvalues < exp(^ fc ' ) ). 

Conditional exponent entropies 

For an invariant measure fi absolutely continuous with respect to the 
Lebesgue measure of M or for measures that are smooth along unstable di- 
rections (BRS measures), Pesin's identity || states that the sum over positive 
Lyapunov exponents coincides with the Kolmogorov- Sinai entropy. By anal- 
ogy one defines the conditional exponent entropies associated to the splitting 
R k x Rm -k ag 



d ft) >o 



(m—k) 



5 (m-fe) >0 
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These quantities, denned in terms of the conditional exponents, that are 
good ergodic invariants, are also well-defined ergodic invariants. Here these 
quantities are defined directly in terms of the conditional exponents. In 
the next section we will describe an entropy construction in terms of the 
dynamical refinements of partitions that correspond to the same splitting of 
the phase space. 

A measure of dynamical selforganization 

In information theory the mutual information I (A : B) is 
I(A : B) = S(A) + S(B) - S(A + B) 
By analogy one defines a measure of dynamical selforganization I(S, E, ji) 

N 

I(S, S, n) = ^ { h M + h m _ k (n) - h(fi)} 
k=i 

The sum is over all relevant partitions R k x R m ~ k and h(fi) is the sum of 
the positive Lyapunov exponents 

A*>0 

I(S, is also a well-defined ergodic invariant for the measure /i. 

The Lyapunov exponents of a dynamical system measure the rate of in- 
formation production or, from an alternative point of view, they define the 
dynamical freedom of the system, in the sense that they control the amount 
of change that is needed today to have an effect on the future. In this sense 
the larger a Lyapunov exponent is, the freer the system is in that particu- 
lar direction, because a very small change in the present state will induce a 
large change in the future. From the point of view of the unit k and of the 
remaining subsystem, the quantity hk(f^) + /i m _fc(/i) is therefore the apparent 
dynamical freedom that they possess (or the apparent rate of information 
production). The actual rate is in fact h(fi). Hence I(S, is a measure 
of the apparent excess dynamical freedom. 
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3 Cylindrical partitions and conditional en- 
tropies 

Consider cylindrical partitions adapted to the splitting R k x R m ~ k , namely 

v (m-k) = |c; m - fe) ,c^ fc) ,---} 

where Cf^ and cj> m ~ k ^ are anc [ m — k -dimensional cylinder sets in R m . 

Let now the ( be a generator partition for the dynamics (/, /i) and define 
the conditional entropies associated to the splitting R k x R m ~ k by 




H (x I v) being 

H( x \v) = -J J2» {c^ I v) in/i (^i x) I v) da 

M/n 1 

That is, the conditional entropies are the supremum over all cylinder parti- 
tions of the sum of the conditional Kolmogorov-Sinai entropies. 

The conditional entropies have, in general, a meaning different from the 
conditional exponent entropies defined before. They might nevertheless be 
useful for the characterization of relative independence between the compo- 
nents of a complex system. In the following, only the conditional exponent 
entropies will be used. 

4 The structure index 

The Lyapunov exponents, as opposed to the conditional exponents, are a 
global characterization of the dynamics. However they may also be used to 
extract information, on the relation between the whole system and its parts. 
If the dynamics of a single isolated unit is known, comparing this with the 
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spectrum of Lyapunov exponents of the coupled system, information may be 
obtained on how the collective motion and coherent structures are organized. 

A coherent structure (in a collective system) is a phenomenon that op- 
erates at a scale very different from the scale of the component units in the 
system. A structure in space is a feature at a length scale larger than the 
characteristic size of the components and a structure in time is a phenomenon 
with a time scale larger than the cycle time of the individual components. A 
(temporal) structure index may then be defined by 



where N is the total number of components (degrees of freedom) of the cou- 
pled system, N s is the number of structures, Tj is the characteristic time of 
structure % and T is the cycle time of the isolated components (or, alterna- 
tively the characteristic time of the fastest structure). A similar definition 
applies for a spatial structure index, by replacing characteristic times by char- 
acteristic lengths. 

Structures are collective motions of the system. Therefore their charac- 
teristic times are the characteristic times of the separation dynamics, that 
is, the inverse of the positive Lyapunov exponents. Hence, for the temporal 
structure index, one may write 



the sum being over the positive Lyapunov exponents Aj. Ao is the largest 
Lyapunov exponent of an isolated component or some other reference value. 

The temporal structure index diverges whenever a Lyapunov exponent 
approaches zero from above. Therefore the index diverges at the points 
where (in the separation dynamics) long time correlations develop. 




T t -T 



T 



(4) 





5 Examples 
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5.1 A globally coupled Bernoulli network 

The dynamical law is 



Xi (t + 1) = (1 - c)f(xi(t)) + JTTifMt)) ( 6 ) 



with f(x) = 2x (mod. 1). 

The Lyapunov exponents are 

Ai = log 2 

A; = log (2 (1 - ^c)) with multiplicity TV - 1 
Therefore, 



h(ji) = log 2 + (JV — 1) log (2 — jfrjc) for c< 



JV-l 



2Af 

= log2 for c>^± 



(7) 



(8) 



2JV 

The conditional exponents associated to the splitting R 1 x i?^" 1 are 

e (1) = log(2-2c) (9) 

and 

= log(2-^c) once; (10) 
& N - 1] = log(2-^c) with multiplicity TV - 2 (11) 

Therefore, 

I(S, E,fj,) = N (log (l - -^—] + max (log(2 - 2c), 0) - max flog f 2 - ' ' ' 



TV- 1 J vov /7/ V ° V N — 1 



which, in the limit of large N, becomes 

J(S,£,/i) = £ c< 



AT-l 



-c 7>f (13) 



The variation of I(S, S,/i) with the coupling intensity c is plotted in Fig.l. 
It grows until the synchronization point and then it becomes negative. The 
transition is discontinuous in the large N limit. 
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Structures 

Except for c = c s = h^jr" the globally coupled Bernoulli system is uni- 
formly hyperbolic. For coupling strength c < c s the Lyapunov dimension 
is N and one expects a BRS- invariant measure absolutely continuous with 
respect to the Lebesgue measure in R . The distribution of the values taken 
by each unit Xj is essentially flat and, for large N, the mean field seen by one 
unit has very small fluctuations. 

However, as one approaches c = c s from below, one sees the dynamics 
organizing itself into synchronized patches, with each patch maintaining an 
approximately constant phase relation with the other patches. Synchroniza- 
tion and phase locking effects are however not absolutely stable phenomena. 
In the Figs. 2 and 3 one shows the statistics of \xi — Xk\ and Xi + Xi+\ — 2x;+2 
. For c = 0.45 one sees clearly the phenomenon of clustering and synchro- 
nization with positive Lyapunov exponents discussed before ||. 

For c < c s all Lyapunov exponents are positive. However, near c s only 
one of the Lyapunov exponents is large whereas all the others are nearly 
zero. That is, there is a fast separation dynamics (sensitive dependence 
to initial conditions) in one direction and very slow separation dynamics 
in all directions transversal to the fast one. The fast separation direction 
corresponds to the eigenvector (1,1,1,1,...,1) 

The slow separation dynamics in the transversal directions corresponds 
to long wavelength effects in phase space which are the most sensitive to 
boundary conditions and the available phase-space. Then, the slow tem- 
poral structures beget non-uniform probability distributions in the linear 
combinations of the variables that correspond to the slow eigenvalues. In 
particular, Xi — Xj+i corresponds to the eigenvector (0, 1, —1, 0, 0) and 
Xi + x i+ i - x i+2 to (0, 1, 1, -2, 0, 0). 

The existence of structures near the transition points where one or more 
Lyapunov exponents approach zero from above is an universal phenomena, 
whereas the detailed form of the structures depends on the particular nature 
of the available phase-space. 

From (|5|) and (|7|) one obtains for the structure index 

S = H=k( /°g2 _ i) for j^jc < 0.5 

N ^ log 2(1- ^c) J N-l 

S = for 5 ^ T c>0.5 

For jtzjC > 0.5 the structure index vanishes because the synchronized motion 
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is effectively one-dimensional and the characteristic time of the synchronized 
motion coincides with the characteristic time of the individual units. The 
structure index is zero both for the uncoupled case and the fully synchronized 
one and diverges at the synchronization transition (Fig.2). 



5.2 Nearest neighbor coupling 

Let now 

Xi (t + 1) = (1 - c)f( Xi (t)) + °- (f(x i+1 (t)) + fix^t))) 

with f(x) = 2x (mod. 1) 

The Lyapunov exponents are 

A fc = log |2 (1 - c) + 2c cos (^-k 

k = 0, • • • , n — 1 

For the conditional exponents, one is 

^=log{2(l-c)} 

and the others are the logarithm of the eigenvalues of the matrix 

/2(l-c) c ••• \ 

c 2(1 -c) c ••• 
c 2(1 - c) c 



V 



o 



o 







c 2(1 -c) / 



Fig. 4 displays the measure of dynamical selforganization / and the structure 
index S for this example with N = 500. The dynamical behavior in the 
nearest-neighbor coupled network is more complex than in the globally cou- 
pled one, showing a greater diversity of distinct dynamical features. This is 
reflected in the behavior of the ergodic invariants. For the structure index, 
in particular, one notices the existence, above c = 0.5, of many points where 
it diverges. These points correspond to the crossing through zero of each 
individual Lyapunov exponent. Also, the invariant / displays three distinct 
regions, rather than two as in the globally coupled network. 
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5.3 A generalized Bak-Sneppen model 

As suggested by the examples above, the most interesting events (creation 
of a large number of structures, for example) occur for particular values of 
the interaction. Therefore, it would be desirable to have a way to adjust the 
interaction strength in coevolution models. This is lacking in the original 
Bak-Sneppen (B-S) model [0. Also, to define ergodic invariants it is more 
convenient to have a deterministic dynamics. Notice however that, even in 
stochastic models, it is possible to define a parameter similar to a Lyapunov 



exponent, by analyzing the spread of damage pi] fl2 . 
The model studied in this section is defined by: 

- iV species, each one assigned to a lattice point in a one-dimensional 
lattice, each lattice point standing for an ecological niche. To each lattice 
point % one assigns a variable Xi (with values between and 1) 

At each time step the site with the lowest Xi and its two nearest neighbors 
are chosen anew according to the law 

Xi (t + 1) = (l-c)/(x i (t)) + f (f (x i+1 (t)) + f (Xi^(t))) 
x i±1 (t+l) = (l-c)f(x i±1 (t)) + l (f (x t (t)) + f (x tTl (t))) 

with f(x) = 2x (mod. 1) 

When c = the function f(x) is a pseudo-random number generator and 
the model is equivalent to Bak-Sneppen's coarse grained model for evolution. 
There are however some essential differences: 

- B-S is a stochastic model whereas this one is deterministic. The updat- 
ing function being differentiable, the tools of ergodic theory are applicable 
and Lyapunov exponents, conditional exponents and entropies may be com- 
puted and used to characterize the dynamics. 

- The interaction strength between neighboring species may be changed 

Parallel versus sequential dynamics 

If instead of sequential dynamics (selected by the smallest x^ one had 
chosen parallel dynamics, this model would be similar to the nearest-neighbor 
coupled Bernoulli chain studied before. Then, a large variety of qualitatively 
different dynamical behaviors are observed, which result from the critical 
points at different values of c where the Lyapunov exponents cross zero. 

When, instead of parallel dynamics, one imposes on the model a sequen- 
tial dynamics selected by the smallest x«, what one is really doing is to 
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introduce a feature that simulates friction or resistance to change in the dy- 
namical system. This has some dramatic consequences for the computation 
of the exponents in the limit of large N . Instead of a tangent map matrix 
of the type described before one has now the product of matrices which have 
ones on the diagonal almost everywhere and only one non-trivial 3x3 block. 
Therefore the Lyapunov exponents become, on the average 

A ~ log (2)^ f times 

A' ~ log(2(l-§c))* ^ times 

Therefore, for large JV, all the Lyapunov exponents approach zero indepen- 
dently of any other dynamical characteristics and the system is near critical- 
ity Therefore the fact that this type of system appears poised on the edge of 
criticality is a consequence of the type of sequential dynamics that is chosen. 

For the structure index, in addition to the divergence effect obtained in 
the limit of large JV, one has other features that arise from the interaction 
between the species, namely 



c<\ S = 4^ + 2 31 ° g2 ^ 



"TO 



3 ' 3r 1 " 3r 

AT 

TO 



C >1 S = ^ 

where r is a reference characteristic time (characteristic time of the individ- 
ual dynamics or characteristic time of the fastest structure) . For defmiteness 
one chooses tq = | log 2. 

One sees that, besides the overall critical behavior arising from the se- 
quential dynamics, there is additional critical behavior at c = | arising from 
the interactions in the coupled block of three species. 

The average conditional exponents are 

fi w ~ log(2(l-c))* 
^-i) ^ Iog(2(l-Ic))* 
log(2(l-|c))- 



and the measure of dynamical self-organization is 



c<\ I = 3(log(l-c)+log(l-f) -log(l-fc)) 

\>c>\ I = 3(log2 + log(l-c)-log(l-±c)) 
l>o| I = 31og(l-f) 
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The values of the structure index and the self-organization measure for the 
generalized Bak-Sneppen model are plotted in Fig.5. 

Not only the ergodic invariants, but also variables like the barrier size, 
show a marked dependence on the coupling strength. Numerically computed 
barrier sizes are shown in Fig. 6. 

One sees that from c = to c = | the barrier stays close to the original 
B-S value. Then, after c = | (the additional critical point of the structure 
index) it grows to a plateau above 0.95. Eventually, as c increases further, 
the barrier size comes back to the original B-S value. This is probably related 
to the fact that for large values of the coupling, when neighboring species 
become synchronized, there is an almost random evolution of three-species 
blocks. 

The scaling of avalanche sizes is another useful characterization in models 
of this type. The avalanche size is defined, as usual, by the number of time 
steps below a fixed threshold. With thresholds for the avalanche definition 
at 0.65 in the first case and 0.95 in the second, a comparison was made of 
the c = and the c = 0.5 cases. In both cases a power law is obtained, 
N(s) ~ s~ a , with a 20% larger exponent a in the c = 0.5 case. 



5.4 A continuous minority model 



The minority model introduced by Challet and Zhang, [14], inspired in Brian 



Arthur's bar modelJI5|, as well as most market models, belongs to a class of 



models in which the agents do not interact directly among themselves, but 
only through a common environment. On the other hand, the environment 
is a collective functional that the agents themselves create. This kind of 
inter-agents interaction, through an external medium, that they themselves 
collectively create, has some specific dynamical consequences. 

Here one studies a continuous version of the minority model. For each 
one of N agents there is a variable Xt with values in the interval [0, 1). The 
average of the values of Xi defines a "mean field" x(t) at time t 



N 

i 

The time evolution of each Xj is only a function of x at times £, t — 1, • • • ,t — 
M. Let c G [0, 1) (called the cut) define a partition of the interval into 
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{A = [0, c), B = [c, 1)}. At each time t if Xi(t) is in one of these intervals and 
x(t) is in the other, agent % wins a point, otherwise it wins nothing. Hence 
one has the dynamics 



Xi (t + i) = fi(x(t),--- ,a?(t-M)) 



and a payoff 



m t (t + 1) = mi(t) + - (1 - sign {(x(t) - c) (^(t) - c)}) 

Each agent has his own function /j, called the strategy of agent i The 
time-delayed law may be converted into a single map in a (M + l)iV space 

\ / fi(x(t),--- ,x(t-M))\ 

Xi(t-1) Xi(t) 



\ Xi (t-M) J \ Xi (t-M + 1) 



J 



It is easy to see that, for models of this kind, the conditional exponents play 
a negligible role. Take for example the case M — 0. Consider the Jacobian 



J n 



dxj(t + p) 
dxj(t) 



The eigenvalues of J T J are N — 1 zeros and one 



N {w^ M E + p - !)) 2 • • • E * w 



Taking the p — > oo limit in 



lim log (J T J) 2p 



one obtains a single non-trivial Lyapunov exponent 



A = lim 

p^oo p 
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For the conditional exponents 

= Iin^coJlog{(i/;(t+p))---(^(*))} 

ef _1) = iim P ^ooMo g {(^E^/;^+P-i))---(^E^/;w)} 

Then, for a sufficiently large number of agents, the conditional exponent ^ 
cannot be positive and the self-organization measure will always vanish in 
the large N limit. The situation does not change if a non-zero memory size 
M is considered. Then the conditional exponent ^ is computed by the 
product of blocks of the form 

/ J_fW if( 2 ) J_ f (M+l) \ 

N->i N •> i N->i 

1 •••0 
1 •••0 

V o o •••o / 

where ff^ denotes the /c-argument derivative of /j . 

For large N the quantities jjf^ are very small and once again the con- 
ditional exponent ^ cannot be positive. The vanishing of the I(S, 
invariant is easy to understand from the qualitative interpretation given in 
Sect. 2. For models of this type, the contribution of each individual agent 
to his own evolution is extremely small and therefore the difference between 
hk{fj) + h N _ k (fi) and h(/i) must be negligible. 

In the original (discrete) minority model each agent is equipped with sev- 
eral strategies choosing, at each time, the one with the best virtual record. 
Here each agent has a single strategy which however may be changed accord- 
ing to the following scheme: 

- At the start all strategies are chosen at random from a pool of functions; 

- After each 10 time steps, the 10 worst performing strategies (in the last 
10 steps) are selected for replacement. The three worst ones are replaced 
by three new strategies chosen at random from the function pool and the 
remaining seven are replaced by strategies that copy the seven best ones 
with a small random error. 

For definiteness consider the functions to be linear regressions with coef- 
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ficients a£ taken at random from the interval [—K,K]. 

M 

Xi(t+1) = ^afx{t-k) 

For sufficiently large K this system self-organizes into configurations away 
from random choice. The most relevant parameter to track the system be- 
havior is 

P(t) = Y i m i (t) 

i 

the total payoff at time t. In the following table one compares the average 
and standard deviations of P for random choice of the x^s in the interval 
[0,1) with those obtained from numerical simulations of the model for several 
values of K and cut c and M — 2. 



Cut 


-Prand 


C(-P)rand 


K 


P 


a(P) 










1 


0.494 


0.1 




0.6 


0.4 


0.049 


1.5 


0.49 


0.099 










2 


0.486 


0.096 










0.5 


0.495 


0.186 


-4.38 








1 


0.499 


0.17 




0.7 


0.3 


0.0459 


1.5 


0.496 


0.165 


-1.13 


2 


0.493 


0.157 


-1.05 








4 


0.483 


0.15 










5 


0.481 


0.157 


-2.2 



P and cr(P) are the average and standard deviations of P(t) and P ran d and 
c(-P)rand the values that are obtained for random choice of the x^s in the 
interval [0, 1). 

One sees that the average value of P is systematically larger than the 
random value, but with a much larger standard deviation. Of particular 
significance is the actual probability distribution of this global variable. In 
Figs. 7 and 8 one shows this distribution for c = 0.6 and c = 0.7. Instead of 
a Gaussian distribution with a small standard deviation, that would be ob- 
tained in the random case, the model organizes itself to have a asymmetrical 
distribution, with an increased average value, which for large cuts splits into 
two peaks 
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The dynamics of the total payoff P(t) 



depends only on the dynamics of the average values 



/ x(t) \ 
x(t - 1) 



x(t) 



\x(t-M) J \x(t-M+ 1) 



J 



where the integers 9i(t) G Z originate from the mod.l operation in the dy- 
namics of the Xj's. It is the dynamics of the average values that determines 
the global behavior of the system. The Lyapunov exponents of this dynamics 
is computed from the Jacobian matrices 



/IV a W 

N "0 






a (0 \ 


1 





■■ 




! o 


1 


•• 









•• 


/ 



Typically, in the (statistically-) stable state of the model, the Lyapunov 
exponents are all negative. They were computed for typical configurations 
obtained after many iterations for several values of K at c = 0.7. This is 
the meaning of the last column in the table above. Although the Lyapunov 
exponents are negative, the dynamics is non-trivial. Without the non-linear 
effect of the 0j's the system would stabilize in a fixed point. Instead, for 
large N, it has very many periodic orbits and the evolution mechanism, 
emphasizing those that have a higher payoff for each cut, acts a selection 
mechanism that drives the system to a particular class of orbits. In the 
Fig. 9 one shows the typical time-behavior of the mean value x(t) after many 
iterations of the model. The fluctuations that are observed reflect not only 
the high period of the orbits but also the change of dynamics imposed by the 
selection mechanism that is operating all the time. 

Thus, the dynamics of this continuous minority model becomes well un- 
derstood. However the role of the ergodic invariants discussed in Sects. 2-4 is 
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not so clear. On the one hand, as explained above, the "mean- field" dynam- 
ics of the model makes the conditional exponents trivial. On the other hand 
the structure index invariant is suited mainly to detect structural transitions 
when a parameter is varied. Here however one finds out that the dynamical 
structure is largely independent of the parameters that have been explored 
(K and c). The structure index might however become useful if this model 
is embedded in some larger class of models. 

Another variable that is relevant in the study of collective model of this 
type is the survival time of each strategy, that is the time interval until it 
follows in one of the (locally) worst strategies. From the simulations that 
were performed an exponential behavior (exp(— is obtained, rather than 
a power law as in the avalanche sizes of the generalized Bak-Sneppen model. 
Also, the exponent is nearly constant, £ ~ 0.004, in the range of parameters 
that was explored 

6 Remarks and conclusions 

A fascinating aspect of complex systems, and even more of complex adaptive 
systems, is that the behavior of the whole is so different from and richer than 
the behavior of the parts. For lack of a precise theory of collective behavior, 
all kinds of new features that appear in the whole are called emergent proper- 
ties. From simple systems with simple rules, complex macropatterns emerge. 
To understand why this is so and what universal features, if any, underlie this 
phenomenon is a challenging task. It is also of practical importance because 
emergence is ubiquitous in the universe around us. 

An almost general rule, in the emergence of macropatterns, is the for- 
mation, through interactions, of subassemblies which combine with similar 
subassemblies, with the structure at each level constraining what emerges at 
the next level. The nature of the interactions between the agents, and then 
between the subassemblies, is the key to the understanding of the macropat- 
terns. This is the reason why, to understand emergence and self-organization, 
it is essential to characterize the interaction dynamics and, in particular, the 
robust properties of this dynamics, that is, its ergodic properties. 

One dynamical effect, identified in this paper, which generates collective 
patterns is the approach to zero from above of one of the Lyapunov exponents 
of the global system. The question is how frequently should one expect this 
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situation to occur. Two basic mechanisms were identified: 

- When there is a natural limitation on the range of values that the state 
variable of each individual agent can take, the coupling must be convex, as 
in the examples studied in this paper. Then, the convex coupling leads to 
an overall contracting effect and Lyapunov transitions are expected when 
the coupling increases. In spatially extended systems, for example, even if 
the interaction law does not change, a change in density would imply an 
effective coupling increase. Therefore in a evolving system where the number 
of agents changes in time (but the available space remains fixed), effects 
of the type described here might be expected to arise when the population 
density changes. 

That, at the transition regions between chaos and order, evolving systems 
display interesting structural properties was suggested in the past by several 
authors ]TB |T7J. Why some natural systems might have evolved to such 



narrow regions in parameter space is, to a large extent, an open question. The 
density-dependent increase of the effective interaction and the contracting 
effect implied by the convex coupling, when the amount of available phase- 
space remains constant, is a dynamical mechanism that might explain, in 
some cases, the evolution towards the transition regions. 

- Another mechanism leading to Lyapunov exponents that are positive but 
close to zero, occurs when agents with sensitive dependent dynamics interact 
via a friction mechanism. This resistance to change has as a consequence that 
only the agents under the largest stress will be allowed to evolve. For a large 
number of agents, this sequential dynamics leads to an effective Lyapunov 
exponent close to zero. This is a situation that seems to occur in many 
examples of what has been called self-organized criticality. These systems 
appear poised on the edge of criticality as a consequence of this type of 
sequential dynamics. 

The approach to zero of the Lyapunov exponents corresponds to the di- 
vergent points of the (temporal) structure index. Another important charac- 
terization of the collective system is obtained by invariants constructed from 
the conditional exponents. These are quantities that distinguish the intrinsic 
dynamics of each agent from the influence of the other parts in the system. 
In particular the measure of dynamical self organization^ discussed in Sect. 2, 
characterizes the excess dynamical freedom that would be perceived by the 
agents themselves. 

Structure indices and the invariants constructed from the conditional ex- 
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ponents and conditional entropies do not, however, exhaust the parameters 
needed to characterize the dynamical and probabilistic behavior of collective 
systems. Scaling exponents, for example, are currently used and, as seen in 
the generalized Bak-Sneppen model, may be related to the other invariants. 
A technique which might also be useful, in the future, is the generalized 
spectral decomposition, in particular the relation between the spectrum of 
the Koopman operator of individual agents with the spectrum of the whole 
system. 

Figure captions 

Fig.l - Structure index and self-organization measure for a globally cou- 
pled Bernoulli network 

Fig. 2 - Distribution of the variable \xi — Xj\ for several values of the cou- 
pling and N = 100 

Fig. 3 - Distribution of the variable Xj + x i+1 — 2x i+2 for several values of 
the coupling and iV = 100 

Fig. 4 - Structure index and self-organization measure for a nearest-neighbor 
coupled Bernoulli network 

Fig. 5 - Structure index and self-organization measure for the generalized 
Bak-Sneppen model 

Fig. 6 - Barrier size for several values of the coupling in the generalized 
Bak-Sneppen model 

Fig. 7 - Distribution of P for c = 0.6 

Fig. 8 - Distribution of P for c = 0.7 

Fig. 9 - Typical time behavior of the mean value in the continuous minority 
model 
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